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ABSTRACT 



This iramo discusses the limited address space in the PDP-11 
archi cecture . 

Tb3 PDP-11 16-bit processor can address a ntaximtun of 32K 
fxndirect or indexed) 16-bit words, A 32-bit version of the 
i>DP-ll could address 16K 32-bit words. 

This aspect of the present PDP-11 architecture is examined 
as a potential problem in larger versions (32-bits) of a 
proposed PDP-11 family. The 16K limit is con^ared with medium 
size computers offered by other manufacturers. It is also 
compared with the expected user requirements of machines in 
this performance category. Finally, this memo discusses brief- 
ly the limit and advantages of two possible memory expansion 
techniques: Paging and Sgementation. 

It is concluded that the 16K limit in a 32-bit PDP-11 would 
be a severe competitive hemdicap. It is further concluded 
that neither paging nor sgementation offers eun efficient way 
to run procedures that exceed 16K 32-bit words. 
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Direct Addressing Capability of Other Computers 

A survey was conducted to determine what direct addressing 
capability other manufacturers offered in their coH^uters. 
The purpose of this was to give a perspective on the "competi- 
tion" and to discover, through their hardware, their estimates 
of the amount of addressable memory needed in medixaro computers. 

In a family of computers, it is the viability of the upper 
end processor (32 or 36-bit words) that would be most limited 
by insufficient address space. Hence, the survey covered 
only processors with word size above 16 bits. 

Representative 18, 24, 32, and 36-bit processors are presented 
in the chart below, as well as the present PDP-11. 



MAXIMUM WORDS ADDRESSABLE 



Processor 


No. 
Bits 


Direct 


Indirect 


Indexed 


PDP-11 (KAll) 


16 


8 


32K 


32K 


PDP-15 


18 


4K 


32K 


12 8K 


DPD224 
XDS 940 


24 
24 


16K 


16K 


64K 
64K 


Sigma 5 & 7 
System 86 
KP Omega 
IBM 360 Series 


32 

32 
32 
32 


12 8K 12 8K 
128K 128R 
Not Available 
4K 4000K 


128K 
128K 

4000K 


Univac 1108 

PDP-10 

GE 635/645 


36 
36 
36 


64K 

256K 

256K 


256K 
256K 


256K 
256K 
256K 



As can be seen in the chart above, the 16K of address capability 
in a 32-bit machine is far below that of other machines in 
this performance class. In the next section, we will examine 
the need for address capability greater than 16K. This will 
be broken down into two classes of systems t the single user 
system and the multi-user (time -sharing) system. 
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The "Market" Need for Address Capability Greater than 16K 

It is simple to say, "everybody knows 16K is too small in 
a large machine." But it is much hsucder to determine the 
correct nusiber. 

Certain facts, however, tend to indicate larger computers need 
greater than 16K. Such system programs as the PDP-15 Background/ 
Foreground Monitor "barely" runs in 16K. More orders are be- 
ing received for PDP-15's with 32 to 64K. PDP-9 customers 
are asking how they ceui put more than 32K on their machines. 
There was such a market for the Ampex 12 8K memory system that 
the PDP-rlO group was forced to market it. The PDP-10 time- 
sharing system requires ed^out 48K to be "respectable" and 
the average PDP-10 system being sold today is ordered with 
64K. 



single User Market 

DEC'S traditional market has been in the scientific market. 
This market often uses the real time capability of the proces- 
sor and has very large problems; simulations, array manipu- 
lations, real time control, etc. It is this class of users 
who probably are most sophisticated in using the computer and 
in evaluating conqpeting processors . They are also the group 
that is often under-funded and, hence, try to get every last 
bit of processing power out of their machine. In the future, 
this group can be expected to attempt to write ever larger, 
more cKnaplex programs as the con^lexity of the problems they 
try to solve increases. 

Consider the implications of 16K of 32 -bit words on a user 
doing matrix manipulations: assume that the user desires 
a high-precision solution emd, hence, chooses to use a quadruple 
word floating-point format (64 bits) to store the matrix points. 
Assume that 8K of the 16K 32-bit addresses available to the 
user are to be occupied by procedure and the othetr SK is to 
be occupied by 3 matrices {allowing [A] + [Bj = [Cj ) . He 
can then have a total of 4K (of quadruple words), or 1,333 
words per matrix. This will allow him to have 36 X 36 matrices 
(1296 points per matrix) . In certain classes of programs, 
this is not sufficient (e.g., linear and dynamic prbgraimning) . 

Paging can be used to extend the amount of core on 'the l»DP-ll 
as is being done on with the RTllA Paging Box. However, as 
will be shown in the section describing paging, it will re- 
quire many instructions eveicy t^me a user tries to reference 
a location outside his ISII^v (and, assuming the monitor allows 
such) to accoE^lish the "i^raniifterr 

Even with paging, a progrsun gr<^ater than 32K would have to 
be split into blocks with aiardbsolute minimum of cross jref- 
erences between the blocks- to run efficiently. This m^es 
it more difficult to write pTOgrams and results in, very f>oor 
.performance v^en they £u:e fi/iially operating. 
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The Conventional Time^-Sharing Market 

This market is characterized by a different set of requirements 
than the single user. In these systems all users are using 
high level languages. In these systems, no attempt is made 
to put all of a user's program in core at once. The core is 
allocated among many users and parts of a given user's program 
are moved into core as the program requests them. This tech- 
nxque obviously does not provide the real-time capability that 
a single user system can and a "job" in time-sharing mode 
(assuming that the job coiitaihs few 1/0 instructions) will 
take much longer to be executed than if the job had all of 
the computer to itself. A time-sharing system will often 
process a job for a finite time slice or until it is waiting 
for some I/O process. At that tin^, the computer transfers 
to another job and, if necessary, moves the first job from 
core onto some secondary storage, usually a high-speed disk. 

It is usually assumed that to have an economically operating 
system, this swapping must occur as it cannot be economically 
justified to have enough fast memory to have all of the active 
jobs totally in core. This philosophy has led to studies to 
determine how to allocate the limited amount of core eunong 
many programs. The studies give the iir?>ression that the first 
rule is to attenqpt to divide core equally among the jobs — 
given equality in the jobs. The result of this memory alloca- 
tion is that program execution speed is limited by the sh?ring 
of facilities and by the time taken as users are swapped in 
cmd out of secondary storage. 

In this situation, the fact that a program exceeded the direct 
address capabilities of the misichine probably would less sig- 
nificantly increase the timie it took to run (con5>ared with 
a single user system), sincse the execution time is already 
limited by the program swapi>i]igf, vritiich is external to the 
program itself. 

To allow programs greater than 32K, however, means that the 
compiler and monitors mu'<*t b<s structured to allow writing 
programs larger than the address space and must break them 
up into parts that can IBe overlaid as the computation pro- 
gresses. This is probably a very difficult task to accon^lish 
and would make large conplex. |>rograms even more difficult to 
document, debug and would Ve^i^ta^nly increase their time to 
run. 
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Pagin^ and Segmentation 

There are two well-known techniques to expand mentory space. 
One, paging has previously been mentioned. This and the 
second technique, segmentation, will be explained and examined 
for possible ways to efficiently run procedures exceeding 
16K on the PDP-11. 
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6eneral Explanation of Paging 

We can conceptually divide a core memory into sections. 
For purposes of example, suppose we divide a menory system 
into sections of 1024 words (sections of 2048, 4096, 512, 
and 128 words are also ccxmaonly used.) We call each 1024 
word section a "page." A nominally 32k memory systan will 
then have 32 pages. Wie 10 least significant bits of the 
address generated by an instruction will tell the location 
of a reference within a page. We say that the least 
significant 10 bits tell the location in terms of a "dis- 
placement" from tbB lowest address of the page. The most 
significant 5 bits of the address determine the page nuiriber 
of the address . 



PAGE # DISPLACEMENT 



5 bits 10 bits 

In a non-paged computer system, the 15 bit address is sent 
unchanged to the memory from the processor. In a paged 
oomputer system a hardware box is placed in the memory bus 
between the processor; and the meiiK>ry. This box passes the 
10 bit displacement address directly to tiie memory. The 
box, however, c^ianges the page number (most significant 5 bits) 
it receives and substitutes a new page nusiber which it sends 
(ui to the nmaoxy, assuming no page fault. The manner and 
reason for this sidbstitution requires eacplanation. 

We will first consider a paging syst«m where the "paging box" 
hardware svft>stito»tes the same size page nui&ber as it receives. 
In our 15 bit address example, this means that the paging box 
sends a 5 bit page nuiid>er and 10 bit displacement to the 
memory. Thus, the address transmitted by the paging box can 
directly address a maximum of 32k as could the original 
address sent into the paging box. 

In a time-sharing system, sei^eral programs may be in core 
at one time. Because each program was written at a differ^it 
time and because se»gments of the memory were already occupied, 
when a program was written one program may be physically in 
several separate non-connected pages. 



Virtual 

Page 

Address 

1 

2 

3 
4 



Core 
Page 
Address 



23 
24 



i/m.w/n, 
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In the^^ove diagram the program is located in cpafe at page 
addresses 4, 7, 23 euid 24. Suppose the prograp»^as written 
for pages 1-4 (note JMP instructions) . It wMild seem that 
there is a problem I The program won't sxite. We could re- 
shuffle the programs in core to place the progrcun in core 
pages 1, 2, 3, and 4. This, however, would be very time- 
consuming and is not necessary with paging. 

Suppose that whenever the paging box receives a page 1 address 
from the processor, it sends to the memory page nuniber 4 ad- 
dress. When it receives #2, it sends §7, receives #23 ^ends -^ 
#3, receives #4 sends #24. Then the program would access 
tiie correct core memory location even though its physical 
page location was different from the page address sent by . 
the program. In this manner, the program never "knows" that 
it was loaded into the physical core in several separate 
places. The progrcun addresses pages 1-4 and operates normally 
as if the instructions were really located at physical core 
locations 1-4. The physical core addresses are sometimes called 
REAL addresses and the program addresses the VIRTUAL addresses. 

Suppose that we wish to have a memory system of nominally 

12 8K of core and that we wish to have 4 different programs 

in core at once on our 15-bit address computer. We will have 

one program in the first 32K, another in the second 32K (the 

assunqption that each progreuD is in a continuous group of 

pages is made to simplify this section. Each program could 

be in any 32 pages with the separations as explained previously.), 

etc. Since we only have a ISrbit address capability in the 

proposed computer, how can we address all 128K? First, recall 

that any one program Will address a maximum of 32K — never 

the entire core. Suppose our paging box, when it receives 
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a 5-bit page number substitutes a 7-bit page ntimber which it 
sends to the memory. This 7-bit page number can then select 
32 of the 128 pages. Obviously when programs are switched r 
the paging box must be changed so that it substitutes a dif- 
ferent page number corresponding to the relationship between 
the VIRTUAL and REAL page #*s of each program. 
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Paging Box Substitution Technique 

Each program has a table as part of it that contains the 
relationship between its REAL and VIRTUAL pages. For sim- 
plicity suppose that the page table is located in memory 
locations 0-31 of the program. In location "0" is the REAL 
page number where program CVIRTOAL) page "0" can be found. 
Hence, in operation, everytime a memory reference is performed, 
the paging box first does a memory cycle to get the correct 
REAL page number, which it sends out to memory. This is clearly 
inefficient as it increases every memory cycle by 1 memory 
cycle. 

A newer technique is to place the page table in a special 
memory called an associative memoiry. The associative memory 
is usually a semiconductor memory that has very fast access. 
For OUT system we would heed a maximum of 32 words in this 
associative memory. First, let's consider the properties of 
an "associative" memory. Recall that a given set of cores 
in a stack has fixed address . The address is determined by 
how the stack is wired. In an associative memory word register, 
there is a place to store the "data" and a place to store the 
"address" assigned to that data. 



Address 



Data I Associative Memory 

Word 



Hence, both the address and the contents are variable. The 
contents of the address part of the word is said to contain 
the address of the data "associated" with it. Suppose that 
instead of 32 such registers, we only have 8 such registers. 
Let's consider first what happens when the page nundaer referenced 
by the program is one of the addresses in one of the 8 registers. 

Suppose that page 4 is requested by the processor. Let us 
assume that his VIRTUAL page is located in page 24 of Real 
core. Then one of the associative memory registers in the 
paging box contains: 

Address Data 



4 


24 



■^^ A.*** 



The 4 from the processQr is compared, in parallel^, with the 
conl^ents o£ the address part of each associative memory 
ree(is^ex:. ' If ,'| itiatch occurs, as "it will here„ the contents 
of ^^ dat^ s^ctiof^ of that associative register will be sent 

' ^ it^l si®aQ^ aia ~ fehe ilEAL^ "p^S"^. ^^dress > ia this essample . 

;" SincW ^ffiQ^citf^d^ctq^ri^igi^q^^^^^ thQ time to 

make the ctMttparison and then place the REAL address on the 
m^oory lines is on the order of 100 nsec. This is about l/lO 
the amount of time it \rauld have taken to do the memory cycle 
if the associative manory had not been there. 

Final ly« let us consider what happ^hs when the VIRTUAL page 
requested by the processor does not match the contents of 
any of the address parts of the 8 associative registers. This 
section will also illustrate how paging can be used to provide 
eua autonatic "overlay" system to make very large gxograms run 
in ccxaputers with a small amount of core. 

When no match occurs, the paging box will address the core 
location equal to the page address it received from the 
processor. This will contain (since it is the page table 
previously defined) the REAL page address (and also soiae 
"control bits") . The box will then substitute the n&ir 
VIRTUAL page number and real page number associated with it 
into one of the 8 associative registers. Then the REAL page 
huanber is sent to the memory. From that time on any reference 
to that page will be processed without a special reference to 
the -core page table. (This assumed that the page v/as presently 
in core.) Suppose that the program was larger than the amount 
of core available. Assume that there is 4K of core and there 
is an 8K program, obviously » not ail of the program can be in 
core at once. Xfe could set up the page table so that VIRTUAL 
pages 0» 1, and 2 w@re associated with real pages 0^ 1, and -2 
respectively. VICTUAL pages 3, 4> 5, 6« and 7 could all be 
associated with real page 3. In this case? when a reference 
f^o VIRTUAL page 4 is made (and some other, virtual page is 
presently in real a>re page 3) the cbmpfufcer first swaps out 
the current cont^t of real page 3, next rolls in the virtual 
page 4 and then places the new address and data in the asso- 
ciative memory; i^inally* the original program referenjcse, coiitinues 
and the program continues. To accomplish this, "control" bits 
are usually part of Uie "data" in the page table in addition 
to the real page aumbe^rs. 

In most of the above description of pagingj, simplifications 
have been made « This is done in order to stress the system 

implications of paging on the addressi»,g stxuctiire of a computer 
system. All aspects of "memory protaetioa" are omifctad. 
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Paging Advantages 

Th© efficiency of a multiprograjaming system can be increased 

if several programs can be kept in core at all times. Withoat 

paging (or relocation^ , the total aiaoiant of core to be shared 

by all programs is limited to tJaat directly addressable by thm 

processor. Hence ^ each program is allovfed 1/n of the total 

core where "n" is the number of programs in core. Ifith paging 

the total amount of core can be increased to the point v/her® several 

programs can have all the core they can directly address. 

This scheme though, requirijng much core, allows a given user 

to take place by merely storing the "maehiKe state" and 

bringing in the previously stored state of the next progrsjE. 

The first user is not swapped out and the next does not have 

to be rolled in from the secondary storage. 

Also, in small systems with minimum core^ paging provides an 
autoralatic overlay technique ao that a small core can be made 
to appear as the maximum addressable core. When a "noa-core 
resident" page is referenced by the program^ a resident page 
is swapped out and the new page is rolled in. The program" 
then continues as if the conputer actually had me larger core. 
Naturally^ it results in a very slow execution of the prograia 
if there is lots of o1?erlay. 
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Usig-q paqiaq to .a.l?t..o^* ixtfeeeduras of qreateer ■■-h-aa i8K 



We have shty^^fr^ that. p3.gir?.g caa be used to iac'rea^e trie a'-eraory 
address space (allcv/ conaecfeion of several tlxaes the aiaounfc 
of addressable core to the processor , We hixve, also, 
shown that the addrass space of tlie PDP~il i.s insaff icieat 
for a 32 bit comput-sr. Ih there a way that: \?e ca-;-? use pagir 
io riui procedure's greacer fc?a'3n, 16IC i!n the PD?-li? 

The answer is ves. Procedures of greater tbaft 16?; cowld be 
run on the PDP-11,., bat fchav ':!?ould run verj; iuef fi,cienfely 
and would increase the GOKipIe3rifc.y of the aysi-'-ems programs „ 



h^§J ^^ }^-.,L sM S&s3K.- 'iS SSM.^ M . 



For progsraias iii asseisbi^ isisc ^ „? t.u e' .ci I 
dasigned -co accapt prot^j -avs c^rcii,"/ .iJ»^i.' .2! 
a ps&grBsi is eiicoimfcered if <^c j .d flaj c; 
him fcaat his program xa-^ -s-^^es "'"''v ?.»w t* il^^ 
kad breksa ife up into "SLb-p"-of ccms. "■ 1\. Lt? 
wDU?».d each liave a sepa^c « ps«je ^uo' e Oi&C "^ i c 
could provide a moaito/" cal! ^-c clif^i^ 't, p*. le ^ 
a branch or refeiren-ce v "as 0ia.c«s o«wn.*r© c I >. 
pirograa. The moEifcor e^^.! 1 v^-^ji^ -i .^z !<■'£. -• » 
siib-prograia asArae aad ofastlrg a5c'c«r£3 ■'i -«. 
IB tlie :KTil-A^, ■sjisis ia^.c*I^^ so chit.\^i 'j hs_ CT r 
and feha User Pregrasj ccui? e* s'^S r"* ""ffjso e t 
regisfeers., Followed b^ . BK a^= tuc .n?" -f 

the booMcaapiag tasks ? £?jjv»c:«, tcJ >'t * .^n (' ^ 
not. be Hscsssaxf' (savkiiq iht^. 3 a e ^„ '^ i* 
The baaiias. user cots Id fc;;^aa>'iit it 3 ■^ci^-u.j'' <i i * 
orgsirsize 'ahe 3iib-"-progr«=.nB i*^ tja ^p^"' "*' n. t 
jaaps over sab-'progrart t>nv«.Cw '"d tl^„i v -'^ 
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Eiqh Level Language Programs 



In higher level languages, however, Fortran, Cobol, Basic*, 
etc., there is no opportunity to "manually re-organize" 
the sub-programs. Utie compiler, unless it is extremely 
sophisticated, can place the sub-program boundaries any- 
where in the program, it could easily place the boundary 
in the middle of a frequently used "DO" loop. Since it 
would prctoahly require 10 to 50 memory reference cycles of 
overhead every time a sub-program boundary was crossed. 
The result would be a very long execution time for the pro- 
gram. 
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Desirability of using paging to run procedares greater 
than 16K. 



In the 32/26 bit class o£ machines « about the only pro- 
grams written in assembly language will be the operating 
systems. We would not expect these to run greater than 
16K euid hence, we do not have to worry too much about 
them. Most of the applications programs will be written 
in FORTRAN or perhaps, BASIC or COBOL. For any large 
program in a higher level language, the use of paging to 
9et the large address space invites disaster. 

Because it is clear that many prograims appropriate to a 
32/36 bit class of machine will run over 16K and since 
most of them will be in higher level languages, the use 
of paging cannot be reccxomended as a solution to the 
limited address capability of the PDP-11. 
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General explanation of SecBPentation 



Segmentation, like paging, is a technique for dividing 
the address space into parts. However, in segmentation 
the two parts (segment, address) are usually each as 
long as the total address space provided normally in the 
machine. We will again consider a 16 bit processor as 
the basis of :&irther explanation. 



15 bits 



Normal Address 




Segmented Address 

Figure 3.1 Normal and Segmented Addresses. 

The segmented address is usually divided into two or three 
parts. For this discussion, we will consider only two 
parts: Segment niunber and Address number. Again usually 
tile address nuoOaer is about 3 bits less than the normal 
address. 



Segment# 



.18 bits 



Addregs# 



bits 



M 



Figure 3.g. S ecroented address divided into two parts. 

This scheme allowsl56K, 2K segments. If we examine the 
15 right half bits, it is clear that this includes 12 bits 
of address and 3 bits of segment number. We could then say 
that we could directly address 8 se^ents of 2K each. 

The goal of the segmentation technique is to provide a con- 
venient way to address the other 255, 998 segments. If this 
can be obtained, then the size of programs for all practical 
purposes can be unlimited. 
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OSiis system accesses the other 255,998 ssgsnents by using 
a special form of indirect addressing. 'She low order 18 
bits of the indirect word ai-e not normally used as the 
indirect word of 36 bits contains only an 18 bit address. 
In a special ITS (Indirect Thru Segment) mode, several of 
the normally unused bits contain .a code which cause the 
18 bit address to be considered a new segment number and 
cause the following word to be fetched and interpreted as 
the address. 




The PDP-11 indirect word has only a single bit that is free« 
and that bit is free only in word oriented instructions. 
The bit is the Byte bit in the indirect address. In all 
word instructions, this bit must specify a word boundary. 

Consider the implications of using this bit to create a 
special ITS (Indirect thsfu Segment) operation. First of all<, 
none of the Byte -^^tructions could be used across segments 
because that bit is used for addressing. MOVE could not 
be used to transfer Bytes from one segment to another. Like- 
wise, the other double operand/byte instructions could not 
operate across segments. The single operand byte instructions 
could reference only witliin their segment. Finally* in a 
ccanpiler envireinment the choice would have to be made be- 
te<?een a multipass 'interativ« cmpiler or one tb.at generated 
ITS indirect addresses for all indirssct references. This 
would be necessary as every time a.a ITS instruefeica ware 
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inserted into the procedure section^ it would bump some 
other instruction out of the segment. The compiler would 
tti&i have to go bade and make ITS instructions out of all 
references to that instruction. This would have to con- 
tinue until all out-^f-segment references were made with 
ITS formats. The only way to avoid this would be for the 
cxxapiler to assume that all references v;ere out-of-segment 
and create the double length address for all memory refer- 
ences. This in the extreme case could iamarly double the 
program size and the execution tiiae. in addition, it appears 
that there would be considerable problems with stacks 
crossing segment boundaries. Because of the problems just 
described; this approach to segmentation cannot be recom- 
mended to extend the PDP-11 address space. 
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IBM 360/Spectra 



ttia IBM and RCA manuals call their addressing techniques 
a segmentation system. As previously defined, the IBM/RCA 
system is not segmentation. "Hhe noooal indirect address 
on these c«aputers is 24 bit long (with space left to go 
to 32 bits) . All they have done is call the high indirect 
address bits the "segment" bits. This is a mat^ar of seman- 
tics and the technique is of no use whatsoever to the PDP-11 
problem. Applying this would be to call the high order 
bits of the PDP-11 address the segment bits - the result 
being the same address space as before. This scheme will 
not be considered further and^ of course^ is rejected as 
a possibility for the PDP-11. 
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Other Schemes 



Several other segmentation schCTies are mentioned in the 
literature. £Tone«^ however, seem to attack the problem of 
extending the basic address space of the machine . ^ey 
are not discussed as their basic rational was for core 
allocation or the technique was so interlocked with the 
ardtiitecture of the particular computer that it was not 
applicable. 
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Secimentation for the EDP-11 



We are, hence, left with creating a special instruction for 
the PDP-11 that says: "Change Segments." Such an instruction^ 
except perhaps in a very expensive version^ would be a mon- 
itor call whicOi would replace a current segment with the 
new one. 'This is identical to the earlier sciheme i»^ich we 
called "paging" and it has the very same disadvantages. 

we are, hence^ forced to conclude, unless a different technique 
can be demonstrated, that the EDP-11 architecture does not 
lend itself to segmentation for address space eacpansion. 
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Conclttsion 

The address space problem is serious in the PDP-11. Neither 
the paging or segmentation techniques eKamined seemed to 
be practical solutions to this. Since in order to be com- 
petitive and to be able to efficiently run large problems 
are requirements for a machine in the 32/36 bit class, the 
EDP-11 architecture must be rejected as a candidate for this 
market. 



